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Abstract 

Recent developments in statistical mechanics have allowed the estimation of equilibrium free 
energies from the statistics of work measurements during processes that drive the system out of 
equilibrium. Here a different class of processes is considered, wherein the system is prepared and 
released from a nonequilibrium state, and no external work is involved during its observation. For 
such "clamp-and-release" processes, a simple strategy for the estimation of equilibrium free energies 
is offered. The method is illustrated with numerical simulations, and analyzed in the context of 
tethered single-molecule experiments. 
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I. INTRODUCTION 



Since the seminal work of Jarzynski in 1997,— considerable attention has been di- 
rected towards the study of exact and directly measurable equalities relating equilibrium 
free energies (or "potentials of mean force") and nonequilibrium measurements (see e.g. 
Refs. . In broad terms, these equalities allow one to compute potentials of 

mean force along a reaction coordinate from the statistics of work measurements in a class 
of nonequilibrium processes, wherein the reaction coordinate is dynamically driven between 
configurations of interest by some external agent. Apart from its intrinsic value as a formal 
generalization of the second law of thermodynamics, the possibility of estimating equilibrium 
free energy differences in this manner bears practical consequences in both computational 
and experimental settings; in the context of computer simulations, for example, the Jarzynski 
equality^ (JE) and the Crooks fluctuation theorem^ (CFT) allow the use of "embarrassingly 
parallel" implementations^^ lowest-variance estimators,^ and unusually large time-steps,— to 
name a few, while in the experimental context they offer a convenient framework to extract 
free energy information from work measurements in processes that are most naturally car- 
ried out in a non-quasistatic fashion, such as "pulling" experiments with single biological 
molecules.i^ 

In the present work, it will be shown that an analogous procedure yielding free energy 
differences from nonequilibrium measurements exists in a different class of processes, where 
the reaction coordinate is no longer dynamically driven between the configurations of inter- 
est, and hence no work or force measurement is involved. In order to introduce this process 
and its associated equality, it is convenient to specialize the analysis to the "tethered" single- 
molecule experiment shown in FigureEJ which is of easy visualization and direct relevance to 
a number of ongoing experiments with biomolecules (see below). In this kind of experiment, 
the end-to-end distance q of the molecule (henceforth referred to as the reaction coordinate) 
is controlled by some external device, which is capable of performing two simple tasks: a 
"clamp" operation, whereby the reaction coordinate is placed and held fixed at a position 
of interest for as long as one desires, and a "release" operation, in which the external agent 
stops acting on the molecule, allowing the reaction coordinate to take on any value. It is 
also assumed that one has the ability to observe the position of the reaction coordinate at 
an arbitrary time r after it is released by the external agent. The combined use of these 
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operations will be referred to as a clamp- and-release process. 

Consider a series of clamp-and-release processes performed in the following sequence: (a) 
The reaction coordinate is clamped at a value of interest until the remaining degrees 
of freedom of the molecule equilibrate with the environment, (b) The coordinate is then 
released at some arbitrary time t = 0, and its position q recorded at a later time t = t. Iter- 
ation of (a)-(b) a number of times allows one to construct a histogram of q that approaches 
a probability distribution, PT{q\qA)i in the limit of an infinite number of realizations. In this 
notation, the function Pr{q'\q) specifies the probability that the reaction coordinate takes 
on the value g', r units of time after it being released from the clamped and equilibrated 
position q. Once this histogram is constructed to the desired accuracy, a second batch of 
experiments is performed, where steps (a)-(b) are carried out with another position of in- 
terest qB in place of qA- Similarly, this defines another probability distribution, Pt(5'|?b)- 
The central result of this work is that these two probability distributions (or, approximately, 
their respective histograms) are directly related to the free energy difference A/ = fs — /a 
between the two configurations of interest, qs and qA respectively, as 



where (3 = 1/ kT is the temperature parameter involving the Boltzmann constant k and the 
temperature T at which the molecule was equilibrated. As this result holds at all times 
r > 0, one can also write it as 



where the histograms of the reaction coordinate are computed at M different times r,; > 0. 
This property enhances the efficiency of the method by taking advantage of the time-series 
of q, rather than a single snapshot thereof, and will be used in the numerical applications 
below. 

Several remarks can be made regarding Eq. (^J) before embarking on its derivation and 
numerical verification. As a quick consistency check, observe that Eq. (Q) reduces to the 
correct equilibrium result when r ^ oo, as in this limit the motion of q is uncorrelated with 
its originally clamped position, i.e. 
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where Peqiq) is the equihbrium probabihty distribution of q; since the equihbrium distribution 
of the reaction coordinate defines the potential of mean force (cf. Eq. ((7j)), this vahdates 
Eq. (0) in the long-time limit. Like the JE and the CFT, the clamp-and-release processes 
that underly this equality take place in nonequilibrium conditions: as already observed, only 
after some relaxation time will the molecule explore its allowed conformations according to 
the equilibrium distribution. However, unlike the JE and the CFT which externally drive the 
reaction coordinate between the states and qs, Eq. (jT)) does not immediately guarantee 
that the molecule will overcome (after some time r) the possible free energy barriers higher 
than kT that might exist between the configurations qa and qb- Though likely to be milder 
in single-molecule experiments, this problem is particularly severe in computer simulations, 
where such barriers essentially prevent the molecule from going between the configurations 
qa and qb in a feasible time-scale. Nonetheless, both in the computational and in the 
experimental context, this rare event difficulty is easily overcome by performing additional 
clamp-and-release experiments at intermediate points between qa and qb', for example, if one 
adds an intermediate point qc between qa and qs so that the odds of the transitions qa ^ qc 
and qc ^ Qb are greater than those of qA ^ qB, the desired free energy difference A/ = 
fs—fA can be computed by simply adding the intermediate free energy differences, i.e. A/ = 
ifc — Ia) + U'b ~ fc), where the free energy differences in parentheses are computed from 
the corresponding intermediate clamp-and-release experiments. In addition to providing 
a more detailed landscape of the free energy surface between qA and g^, the information 
contained in the intermediate histograms lends itself to a simple strategy allowing one to 
make educated choices of additional intermediate points as the experiment is performed (see 
below). 



II. PROOF 



Although a full proof of Eq. ^ from first principles will be offered shortly, it is interesting 
to note that this result follows almost immediately from Onsager's statement of microscopic 
reversibility (cf. paragraph after Eq. (4.2) of Ref . 0, or Ref. 10 for a modern proof), which 
in the present context and notation reads 



Peqiq, h; q', ts) = Peq{q', h; q, ta), 



(3) 
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where PeqiQ, ti; q'; ^2) is the joint probabihty - in equihbrium - that the reaction coordinate 
takes the value q at time ti, and the value q' at time t2 > ti- (Note that this statement is 
strictly distinct from Onsager's regression hypothesis, also put forward in the same paper 
above, which relates the decay of equilibrium correlations with nonequilibrium relaxation 
processes, and only applies to small external disturbances^^). From elementary probabil- 
ity theory, one can decompose joint probabilities in terms of the associated marginal and 
conditional probabilities, e.g. 

Peq{q, h; g', ts) = Peq{q) Peq{q', t2\q, ti), 

respectively, where Peq{q' ,t2\q,ti) is the conditional probability that the reaction coordinate 
will take on the value q' at ^2 given that it had the value g at ti. Upon substituting this 
decomposition in Eq. Q, we arrive at Eq. (P), with t = t2 — ti and the identification 
Priq'lq) = Peqiq',T + ti\q,ti). 

As hinted by the above derivation based on Onsager's reversibility principle, Eq. 
ought to depend upon the property of time-reversal symmetry of the microscopic equations 
of motion. There are several deterministic and stochastic models that embody this property, 
and Eq. should be insensitive to the specific model chosen. In fact, Eq. (jS)) follows directly 
from the time-reversal property of time-correlation functions. For example, in Ref . |lj a time- 
reversible Hamiltonian model was used to derive a symmetry relation in chemical kinetics 
that is essentially Eq. in particular, that derivation reveals the validity of this equation 
even when the molecule is coupled to a non-Mar kovian heat bath. The derivation offered 
below is somewhat simpler, as it assumes a Markovian heat bath and discrete time (see e.g. 

n 

Ref. I2 for a similar approach), but the generality of Eq. should be born in mind. This 
derivation also makes direct contact with Monte Carlo simulations, which will be used later 
in the paper to illustrate the validity and use of Eq. ((H). 

In accordance with the above discussion, let us begin the derivation of Eq. (0) by defining 
the clamp-and-release probability as 

Peqixo)5{q{xo) - qA) 

Peq{qA) 

X P(a;i|a;o) • ■ ■ P{xt\xt-i)5{q{Xr) - qs), (4) 



PriqBlqA) = J dxo---dXr 



where Xt is the phase space vector containing all the degrees of freedom of the molecule at 
time t = 0,1, ... ,T, P{x'\x) is the dynamic transition rule of the Markov chain dictating 



the probability of going from state x to state x',— and q{xt) is the function that yields the 
value of the reaction coordinate for a given configuration xt- Note that the initial statistical 
state is correctly normalized by the factor PeqilA), where 

Peq{q') = j dx peq{x) 5{q{x) - q') , 

and Peq{x) is the unconstrained equilibrium distribution of the molecule. In this stochas- 
tic model, the property of microscopic reversibility is often expressed dynamically by the 
"detailed balance" condition, namel y^^i^^ 

Peq{x)P{x'\x) = Peq{x')P{x\x'), (Vx,x') (5) 

where x indicates the time-reversed counterpart of x in which all components of x that 
are odd under time-reversal (such as momenta) have opposite sign.^^ This ensures that 
the probability of observing the trajectory xo,xi, . . . ,Xr is identical to the probability of 
observing its time-reversed counterpart Xr,XT-i, ■ ■ ■ ,^0, i.e. 

Peq{Xo)P{Xi\Xo) " ■ ■ P{Xr\Xr-l) = Peq(Xr)P(x^-l\Xr) ■ ■ ■P(xo|Xi), 

as can be straightforwardly verified by successive application of Eq. (0) in the left hand side 
of the above equation. Using this result in Eq. (@]) and rearranging terms, we have 

/ I X PeqiqB) /", , PeqiXr)6{q{Xr) - qs) 

PAqBiqA) = 7 — r / dxr ■■■dxo 7 — r 

PeqiqA) J PeqiqB) 

X P{xr-i\xr) ■ ■ ■ P(xo\xi)S{q{xo) - ^a)- (6) 

Upon changing all integration variables to their time-reversed counterparts (this comes with 
a Jacobian of unity) and using the fact that the end-to-end distance is invariant under 
time-reversal, i.e. q{x) = q(x), one can recognize the resulting integral as PriqAlqB)- The 
remaining ratio of equilibrium probabilities is related to the potentials of mean force through 
the usual definition 

e^'^^('^)^Pe,(g), (7) 

which finally yields Eq. (^. 

III. NUMERICAL RESULTS 

To illustrate the validity and use of Eqs. (HJ-Q, the free energy surface of a one- 
dimensional model comprised of a particle experiencing a barrier of height ~ 20/cT was 
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reconstructed (see Ref.y for a similar approach). The specific profile of the potential is 
shown in Figure along with the free energy surface reconstructed via Eq. (j21) with a total 
of 20 points between the two minima of the potential (as only free energy differences are 
available, one point is lost to set the "zero" of the vertical axis). Note that the free energy 
surface coincides with the potential energy, in accordance with the dimensionality of the 
problem. In these Monte Carlo (MC) experiments, 100 trajectories of 100 MC time-steps 
each were generated with the standard Metropolis algorithn>i^ from each clamped position, 
and M = 10 observations equally spaced in time of the coordinate q were used to construct 
the histograms required by Eq. (j2I). 

Though the agreement observed in Figure |V| illustrates the validity of Eqs. ((T]) and Q, 
it offers little insight into the advantages and drawbacks of the method. In particular, it is 
important to understand the aforementioned rare event issue in more detail. To this end, 
snapshots of the distribution of the reaction coordinate after being released from two nearby 
positions (namely, q = —0.6 and q = —0.5) are shown in Figure IVl For these histograms, 
10,000 trajectories were used so as to obtain smoother curves, although the general profile 
of the distributions is essentially unchanged with only 100 trajectories. The first direct 
observation is that both distributions are moving towards the nearest minimum at g = — 1 
(as indicated by the horizontal arrows), in agreement with the expected behavior due to the 
positive slope of the potential between q = —1 and q = 0. This asymmetry of visits to the 
left and to the right of the original clamped position is a manifestation of the rare event issue: 
Pr{—0.5\ — 0.6) is much smaller than pr{—0.6\ — 0.5) (cf. circles in Figure IVj) . However, this 
drawback can be turned into a diagnosis tool: suppose, for example, that one had measured 
Pt{(i\ — 0.6), and that one were sweeping the clamped positions of the reaction coordinate 
from left to right. The form of the distribution Pr(Q'| —0.6) can be used to make an educated 
choice for the next point to the right of g = —0.6, e.g. by establishing a threshold value of 
the probability and choosing the value of q that corresponds to this threshold. This ensures 
that one will be spending most of the time and effort in regions dominated by steep energy 
barriers, while alleviating the effort in regions where the distributions move about in a more 
symmetric fashion. 
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IV. APPLICABILITY IN SINGLE-MOLECULE EXPERIMENTS 



The above results suggest that the clamp-and-release method might be useful in single- 
molecule experiments, which are becoming a standard research tool in various laboratories 
worldwide (see e.g. Ref.Qfor a review). In these experiments, one is able to isolate, manip- 
ulate, and to a certain extent "observe" an individual biological molecule (e.g. DNAs, RNAs, 
and proteins) at the micron-to-nanometer level, through a setup much like the one shown 
in Figure Although the application of Eqs. and (j21) is in principle straightforward in 
this context, there are some discrepancies between the idealized clamp-and-release process 
introduced in connection with these equalities, and the actual processes and measurements 
one is presently able to perform in such experiments. Here only a few of these issues will be 
discussed, namely the stiffness of the trapping potential, the ability to observe the reaction 
coordinate g in a time-resolved manner, and the effects of the bead on the dynamics and 
statistics of the molecule. These items will be discussed separately below. 

In tethered single-molecule experiments, one routinely manipulates the position of 
polystyrene beads attached to the molecules of interest by means of laser "tweezers," which 
effectively induce a harmonic confining potential on the bead.— Associated with this confin- 
ing potential is the existence of thermal fluctuations about its minimum, thus in principle vi- 
olating the premise of the clamp operation. However, a back-of-t he-envelope estimate based 
on the equipartition theoremiS' suggests that such spatial fluctuations are orders of magni- 
tude smaller than the nanometer scale one is often interested, namely (Ax^) ~ 10"^^ — 10^^^ 
m, and hence negligible in the present context (assuming room temperature and the stiffness 
range 10^^'^ — 10~^ N m~^ encountered in typical optical traps-^). Note that more careful 
studies in the context of the JE (where a general result explicitly accounting for the external 
potential exists^) have led to similar conclusions.— 

As the present method requires time-resolved observations of the reaction coordinate, the 
ability to track the position of the tethered bead is an essential ingredient for its successful 
implementation. This can be achieved through the rapidly evolving single-particle tracking 





2J21 
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experiments for over a decade (see e.g. Refs.ll9||20||2l|j2aj23||2J). The use of SPT combined 



with optical traps has already been adopted for quantitative studies of the motion of proteins 
in the outer membrane of E. coli bacteria,—- where the A-receptor protein was tethered to 
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a polystyrene bead, which was in turn manipulated with a laser trap and observed with 
SPT techniques. A more recent study has reported the use of evanescent-wave methods^! to 
obtain a full three-dimensional characterization of the bead position with excellent spatial 
(nm) and temporal (30 — 350 Hz) resolution. Together with laser trap techniques, this 
setup seems to offer a natural setting for the use of the clamp-and-release methodology, 
which can induce barrier-crossing events (i.e. new conformations) otherwise not observed in 
a feasible time-scale without the clamp stage. 

Finally, a crucial question is whether the presence of the tethered bead affects the prop- 
erties of the standalone molecule one is ultimately interested in. For example, it is clear that 
the dynamics of the molecule (and hence that of q) is appreciably affected by the presence 
of the relatively heavy bead, which also experiences a viscous drag as it travels through the 
surrounding fluid. Moreover, even when it is held in place by an external field, the presence 
of the bead might change the allowed conformations of the molecule of interest by simple 
volume exclusion.-^ Instead of trying to characterize all such effects separately, it is best 
to view the results of tethered single-molecule experiments as probing either dynamical or 
equilibrium properties of the bead-molecule complex. Thus, although the dynamics of the 
complex differs from that of the standalone molecule in a non-trivial fashion, the equilib- 
rium properties (such as free energy differences) are essentially affected by volume-exclusion 
only. This has been the subject of a recent theoretical investigation,— which concluded that 
- in the particular context of Figure I3 where one end of the molecule is attached to a glass 
slab - the size of the tethered bead does influence the equilibrium properties of the molecule. 
However, these effects are expected to be minimized when both ends of the molecule are 
attached to beads, as in this case the motion of the tethered bead is no longer constrained 
to one side of a plane only, but a more careful study in this case does not seem to be 
available. More importantly, in this particular two-bead context, a technique that further 
minimizes volume-exclusion effects is the "molecular handles" approach of C. Bustamante 
and collaborators,-^ in which the molecule of interest is connected to the beads through 
parts of DNA or DNA-RNA hybrids. In this case, a systematic study has shown that the 
effects of the handles and of the bead surfaces on the properties of the molecule of interest 
are negligible, at least under typical experimental conditions, and provided the handles are 
long enough.— This technique also seems to be an important ingredient for the success of 
the clamp-and-release method. 
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V. CONCLUSIONS 



In summary, a nonequilibrium method for the estimation of equihbrium free energies 
based on a "clamp-and-release" methodology has been put forward, and analyzed both in 
computational and experimental contexts. Underpinning the method is a simple equality 
based on the property of time- reversal symmetry (Eq. (P)), which relates equilibrium free 
energies to repeated observations of the reaction coordinate as the molecule relaxes from a 
clamped nonequilibrium state. This equality and the associated clamp-and-release process 
differ fundamentally from existing nonequilibrium methods based on the Jarzynski equality 
or the Crooks fluctuation theorem, as no work or force measurement is involved. Experi- 
mentally, this might be particularly useful when the external device controlling the reaction 
coordinate is not directly capable of performing force measurements, as in the case of the new 
generation of nanotweezers based on carbon nanotubes .^^i^^ Computationally, the method 
offers a conceptually simple algorithm for the estimation of free energy differences that is 
particularly suited for problems involving the crossing of high free energy barriers along a 
known reaction coordinate (cf. strategy based on intermediate points above), which com- 
plements existing equilibrium and nonequilibrium methods.~ It remains to be seen how the 
efficiency of the present method ranks against such methodologies. 

Acknowledgments 

The author is indebted to Prof. Jimmie Doll for his guidance and advice. Discussions 
and/or correspondences with Prof. Carlos Bustamante, Dr. Gavin Crooks, and Dr. Christo- 
pher Jarzynski were also fruitful. This research was supported by the US Department of 
Energy under grant DE-FG02-03ER46074. 



* Electronic address: lartur@brown.ediil 

1 C. Jarzynski, Phys. Rev. Lett. 78, 2690 (1997). 

2 G. E. Crooks, Phys. Rev. E 61, 2361 (2000). 

3 G. Hummer and A. Szabo, Proc. Natl. Acad. Sci. (USA) 98, 3658 (2001). 
^ D. A. Hendrix and C. Jarzynski, J. Chem. Phys. 114, 5974 (2001). 



10 



5 M. R. Shirts, E. Bair, G. Hooker, and V. S. Pande, Phys. Rev. Lett. 91, 140601 (2003). 
^ W. Lechner, H. Oberhofer, C. Dellago, and P. L. Geissler, J. Chem. Phys. 124, 044113 (2006). 
^ J. Liphardt, S. Dumont, S. B. Smith, I. Tinoco Jr., and C. Bustamante, Science 296, 1832 
(2002). 

^ D. Colhn, F. Ritort, C. Jarzynski, S. B. Smith, I. Tinoco Jr, and C. Bustamante, Nature 437, 

231 (2005). 
9 L. Onsager, Phys. Rev. 38, 2265 (1931). 

S. R. de Groot and P. Mazur, Non- equilibrium Thermodynamics (Dover, New York, 1984). 
^1 Private conversations with Christopher Jarzynski were very instructive in elucidating the con- 
tents of Onsager's original paper. 
^2 A. B. Adib, Phys. Rev. Lett. 96, 028307 (2006). 

J. R. Norris, Markov Chains (Cambrige Univ. Press, Cambridge, UK, 1997). 
G. E. Crooks, Phys. Rev. E 60, 2721 (1999). 

D. Frenkel and B. Smit, Understanding Molecular Simulation: From Algorithms to Applications 
(Academic, San Diego, 2002), 2nd ed. 
^6 C. Bustamante, J. C. Macosko, and G. J. L. Wuite, Nat. Rev. Mol. Ceh. Biol. 1, 130 (2000). 
J. M. Schurr and B. S. Fujimoto, J. Phys. Chem. B 107, 14007 (2003). 

18 G. Hummer and A. Szabo, Acc. Chem. Res. 38, 504 (2005). 

19 D. A. Schafer, J. Gelles, M. P. Sheetz, and R. Landick, Nature 352, 444 (1991). 

20 L. Finzi and J. Gelles, Science 267, 378 (1995). 

21 G. Zocchi, Biophys. J. 81, 2946 (2001). 

22 L. Oddershede, J. K. Dreyer, S. Grego, S. Brown, and K. Berg-Sorensen, Biophys. J. 83, 3152 
(2002). 

2^ N. Pouget, C. Dennis, C. Turlan, M. Grigoriev, M. Chandler, and L. Salome, Nucleic Acids 
Res. 32, e73 (2004). 

2"^ S. Blumberg, A. Gajraj, M. W. Pennington, and J.-C. Meiners, Biophys. J. 89, 1272 (2005). 

25 H. Qian and E. L. Elson, Biophys. J. 76, 1598 (1999). 

26 D. E. Segall, P. C. Nelson, and R. PhiUips (2005), e-Print archive: |q-bio.BM/0508028 
2^ Carlos Bustamante, private communication. 

28 P. Kim and C. M. Lieber, Science 286, 2148 (1999). 



11 



Figure captions 

FIG 1: Illustration of a "tethered" single-molecule experiment (not to scale) relevant to 
the clamp-and- release method. In both cases (a) and (b), one end of the linear molecule 
is attached to a nonreactive bead while the other end is attached to a fixed surface, which 
can be either a glass slab or another bead held by a micropipette (not shown), (a) Initially, 
the reaction coordinate q is clamped by means of an external device, here represented by an 
effective potential energy surface surrounding the bead, (b) The molecule is then released 
by the external device, thus allowing q to take on any value. 

FIG 2: Potential energy (solid line) used in the Monte Carlo simulations described in the 
text, and the "free energy surface" (circles) reconstructed via Eq. with M = 10, and 
100 trajectories for each point. The bin size of the histograms was Aq = 0.1. 

FIG 3: Histograms of the reaction coordinate at two different times, t = 30 time-steps 
(upper box), and t = 100 time-steps (lower box), from an MC simulation with 10,000 
trajectories. For each time, two distributions are shown: one that was originally clamped 
at g = —0.6 (solid curves), and another at g = —0.5 (dashed curves). The vertical lines 
specify the original clamped positions of the reaction coordinate at g = —0.6 (solid lines) 
and q = —0.5 (dashed lines), while the circles indicate the intersection of a given curve 
with the original clamped position of the other, yielding the probabilities Pr{—O.Q\ — 0.5) 
and Pr{—0.5\ — 0.6). The horizontal arrows represent the displacement of the peak of the 
distributions from their original positions at t = 0. 
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